Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add missing requirements spirv-val to tests #2760

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

mateuszchudyk
Copy link
Contributor

There is a feature that checks if spirv-val exists, but no test that uses spirv-val requires that it exists.

There is a feature that checks if spirv-val exists, but no test that
uses spirv-val requires that it exists.
@mateuszchudyk
Copy link
Contributor Author

Two actions failed on the test constant-loclist.ll. This PR doesn't touch this file so the problem seems to be on HEAD.

@svenvh
Copy link
Member

svenvh commented Oct 17, 2024

It would be good to hear @MrSidims 's opinion on this too, but I am not keen on making spirv-val a hard requirement for this many tests. Ideally, if spirv-val is not available, the test would skip validation but should still run the other steps.

@MrSidims
Copy link
Contributor

I agree with Sven, we shouldn't skip that many tests.
Btw, I've just make a quick check on my machine with spirv-val non-installed and got the following result:
Total Discovered Tests: 877
Unsupported : 74 (8.44%)
Passed : 799 (91.11%)
Expectedly Failed: 4 (0.46%)

I interpret the result like this: there tests that require spirv-as/spirv-dis - and they are skipped. Meanwhile spirv-val tests are still being run as the number of Unsupported tests doesn't match the number of tests modified in this PR. So the question is: why do we need it?

@mateuszchudyk
Copy link
Contributor Author

mateuszchudyk commented Oct 17, 2024

Makes sense. So basically what we want is that if there's no spirv-val then we want to still run these test and skip just a spirv-val step, right? Now I see that in the lit.cfg.py:L80 there's no adding spirv-val to available_features and the else statement is most likely used to bypass this check (I guess). So to sum up I think we can drop this PR.

@svenvh
Copy link
Member

svenvh commented Oct 18, 2024

the else statement is most likely used to bypass this check (I guess).

Yes exactly, the else turns any spirv-val command into a no-op if spirv-val is not detected.

@svenvh
Copy link
Member

svenvh commented Oct 18, 2024

I think a comment to explain the optionality of spirv-val would be helpful, so I've opened #2765

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants